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are transmitted as additional information of the two-dimensional data, together with the two-dimensional data. On the receiving side, 
from data on the background, building, and automobile videos (101, 102, 103), the depth map, a synthesis video (e.g., 3-D of a ball 
(105) created by a computer), right- and left-eye videos (104R, 104L) to which parallax is given are created; and it is judged from the 
thickness value of the building video (102) whether or not the ball (105) created on the receiving side will collide with the building 
video (102). 

(57) &$3: 

mmmxn^ m^<o 2 ^tcb*^ (100) i^m vrm^^-vf %n 

^ > (101) % if ;V<D Bfc m. (102) N gl$o^f (1 

0 3) £ttffl1-5 0 ^^fciiilS^fcRft^t^^x^ hiLTifc 

mm t Ltiits. Sit ftij-ete. fts^t (101) N \f ;v(D^m. 

(10 2) , i Uj HH C£> g!fc # (10 3) (D&f — „ "f^f^-^v-f, ii 
f&m&:& ( fcf s ^^t^-^lci.to-C^^^tLfc^ — ;v (10 
5) <£>3D) fcS-^-C*E^3r # PLti^mmm. (10 4R) RXftEm 

O 4 L) &±j&-$-Z> 0 ^LT, &m m X J$ £ tl fc ^ - 
(10 5) & x \?/UCDykj£ (102) t m ^ i" 5 J&> S ;*» tf) ¥ U ^ £ tf >V 

<D9km. (102) <£> JH ;Mi£ ^ S -3 ^ t *t 5 0 



WO 2004/049735 



1 



PCT/JP2003/012177 



m m m 

B^ft^X-xA^tim^^-CL^-g) (#|2 0 0 0-7 8 6 1 1 o 

15 ft<t &i#i=ri::;fc^-c. *u 7i-c-;u>^*!:£ a, g iz m tz 5 Z 

d<D*^a>fi:tt:^[ffllfe«att^gfe(d: % ± IB <D II S £ ffi Sfe f £ fc A I = . 



WO 2004/049735 PCT/JP2003/012177 

2 

& 7c B* « O =r - * t ft [ c m m T Z> C d: * ft fg £ f -5 . 
c £ iz 3 „ 

15 #ti:t§ 0 

frfr&#|Ji!clCfcl\T** 2 Bfc«± (D iST ~3 is x £ h 0> # BU flfj ft S $ 

^-r jmt <t nfiy^s^^-rm^^if fg <t ic & -? x±wmm^± 
$j ba^ £ £ jjfef & ifB- iz fc i\ r , c <7) »i b*^o) a Taws t <om mm 



WO 2004/049735 PCT/JP2003/012177 

3 

*7t. -CD3glB<D£tt«ffll1ft«ijS#2r£|* % 2 &7cR*&£-7*— $ <h L 

* fitfifc ic i\ r * . 2 &5c nsMfe± cD#Mfg cr t <r> ^mnytfca £ ^ 

IBfS^^-v(DfBi5(7)lx-r^i^[Cck y fr£5 «fc 5 lc Lt t «fclx 0 £ 

£ em -it n x. xsm n m m. <o *p & < t & - o o mm b# m $s z itris 2 & tc m 

15 ££ix 0 

ii^^s^-r^«!:ixo7cc«!:^Rrtg(h^^o £tc, « mn^omm £ 



WO 2004/049735 



4 



PCT/JP2003/012177 



%.7t&wi(Dttm j mmv & & una 2 & 7tm%±(ommxiti- *> x o k o 

10 tlZtji&c 

^7ca*^±(D^^i?x^ hcD^1^IflJ^e^^•rM^T#•ltfg<!:!rSou^T 
& 5t ft ± <d & m m z t <d bu m & e * ^ -r a *t * it # s 1 1 c & -31 % r :& 

«s a sua hums, m&mmmm. ».xsmnmm<ot3:i^<D^< t 

o 



WO 2004/049735 



5 



PCT/JP2003/012177 



mmmmizm^^x -mmzmiRx£& 0 m*.&* 

mi (a) (b) (c) itc.(Dmm(ommmm<D±wmm^mmyj 
Ltzmmm~e&z> 0 m2 ( a > Mi^m (b) \z*Lm%mv&m<D 

10 fei^* — 7 y LfcBlKia-efc*, HI 3 f*fl5^!pJ3e^^-rBiK 

HtftoT, IB (a) l*tt«£5*U l^m (b) l*J5^'ltfg^fe^ii 
^^il, HH (b) l*JS*M!NR#&Ul§££5S LT l^& 0 HI 4 (a) 

(b) (c) itzti^ti&m&mm a&mvkm) om^iz-D^xomm 

15 

fg m % m m ? & tz #> <d m m o m m 

? h<DBfrmmk&f&&&k(Dmmmiz'D^xmwLx^< o 
^<Dmizt$^x\t. jfcs£^-r ^(d-^-m*^ t Lxmi& 

ati&mmmt* mm&mmm^*? ^mmmm^m^.tz^-y-)-)u^ 

25 1^11] (a) l*H¥©2^7C0A^1 OOl^LTl^. ill If iU "<? I£ . 2 
^7nR*^1 O OlzMLXmigtrttftZftlK mm (b) l-^-Tcfc^lc. w 



WO 2004/049735 PCT/JP2003/012177 

6 

ejKowi 02, sttimcD^^ i o 3 £tetb-r&o c 

ft&o ® fl i£ ft T?JMt# fit f^T'^JSitS, ft 

LT * cfc 

10 O VM-^LX^-XX % £ Lofr*_ftU 0 £fcx 2 &(7>t^X^;/ 

ticcfcy, ^ft£<DM#T*j5^;6^£.§> z t icft£ 0 ^fc, 2^(7)^^ 

15 -A(D2^^W^|--3>^r[*^ltj{|lJfeS^^1-atT^1t#$-^X, $i<D 
7 Is — A(D2^7c^^[COUTI*ai|iJfeS^^-rM^T^'ltfg^^x.'i. i: 

%.7zV&m<D?-$ <t ic&£ 0 i£lfc: ferret. 

Jx^<Dfc&<7)M^;U^ L^X^3I£?Tft ? 0 fJfEJ5#.'lf $g£^A 

■r^7i^(^7^— ha>--f$ij$ni2 (a) [Z7jkir 0 ^<r>? * — y h 



WO 2004/049735 PCT/JP2003/012177 

7 

10 iE©HtT#fitT?fcSo 

mi (c) ic^-tcfc^lc, g««|l** W^lft^l O 1 , b?;Kzm#i 
02, g«jS<Z)Bjfe^1 O 3<D#-x-$&tfttJi'li$B£glf -T&o ^ft£ 

^— £ #-7 )\,=f- -J b ^ x $ *i r & o x i£-r v ^ u ^ x mm. £ 
15 4iz&-3i\tzmmtei?*mmtsti&o fit, samm-ci** fiM 1 

01, t'iKClil 0 2, SHim^Bifeft 1 0 3 O&^r — £ , 7 s Z? X V y 
^, ^fiKfflB*^ (MZ.\£s =i > ea-$ l=«fco-C^fifc$*Lfc7l?— ;n o 
5CD3DBiMt) lcS^^T^SM$#X.f=^fiSR*^1 O 4 RRlStEmtkm 
i 04L^«t^ o tot, 7-$&%m-f&tcisb(D^ 

viz* mmmftmmiz&^^x. mt^m^±<Dm^^ tmt^mmn 



WO 2004/049735 



8 



PCT/JP2003/012177 



WommikOtz&b. S3 (a) Ictf Ltl^i: o 1 o 1 <D 

&fT#fiSA<1 0 0. t*;U(D^^ 1 O 2 ©J|?T#fitJ&<5 O ^J?^fit^3 O , 

;n o 5 outfit 7^5 5tl^i^l t-fc^tt-S. Zft£<£> 

5 itfgicso^ s m3(b) ic^-r^aic. 7t?-;n o 5 itsmmowm 

JMt £ fit tf><5* Ill 3 (c) l:##^Ltito CtL^><DlH^ 

io it^Tiiiiijt^^M^^e^KDBife^ i o 2<DHij@£&-r®n±[cfe@L7t 

3.-^[* s ?H-;ui o 5 (7) Si Lfc dUkteilofc) t^-;h 0 5 
(D 3 DRjjMt££j&-f <?> C t t-&6o JMT#til(£><7*(7)ii£l;£, tH- 

15 ;n 0 5 I* e;KZ>R*« 1 0 2©JSlotL*3lft«lcS:otL*5. 

(a) [*£ft;&P3M£ (H?) ©ui^ro^^SLt^s. :<D@-eit 

Jg*£****B (t^iH) * * ^ 1 , ±I^^2 S * * ^ 3 . * 

^74, *^^5, *^^6[Cd:oTJSi0LTfcys 6ft£<7) 2 ^TcBJfc 

20 «35^6+i^o f itx ^<D6ii^(7)2^7c^^$T t — £ £ uresi-r 

0©«KB*fll|R*«rC2 3fc5cl|**fl!)ttJlfliai: L X m Wi 2 &tcH*&<7) 
i:^lcfe^-r-g, 0 IH4 (b) [*^ft£0jM£ CM) a>flfc»BSa>flfeO) 

^71 2 ( 2) ^ 1 3 . * P< 7 1 4 . *^^15. ^716, *l P< 



WO 2004/049735 



9 



PCT/JP2003/012177 



7c, 0 4 (c) CItf^ 5 I::, i* # ft & fcl A £ Eft 6, 1^(7) 

5 71^ ^IZTJii^-r^C^ICcfcor^s £&£<D2&5ul|*«l£f#ac:£rt< 

EHEj*ft*»««Ffl|*lC^feT*J:l\. 14 (b) 
( c ) izvf; LtzJj : M\z& vmztitz&mMO) 2 &5clijMft<D-x — * <b^|z 

&m (m7jkB&m<D&wm) iz3&7t&Mm. : £5-7Lz>c. trfx*$^ mmm 

£ (3 >K5cT-£ |7Sl[c^¥@J^^IBS-r ^ z: t^m^ttj:^) 0 coif 

Slc^^ y£X/\*y -Vt?Bife^^llLrmi>^;i^i:7b<fc-g> 0 

t?£<S>o fit, IH5 (E5I£|H4 (a) Icftjfc LtzmVfoZ) L 
Xl^Z&olZ^ *Z?*>JL<7l*AtimmmElZ$£l\t%\Zlt. **?2k 

^73 ^ 4<Dvkm&miR?% 0 



WO 2004/049735 



10 



PCT/JP2003/012177 



it * o m m 

1. 2&5cWl« ^t ? — £ i: LT^^-ri>l^lc, lufB 2 &7c#Hi COST- 
S' frlB2 3fe5cltt 

5 «_t©;*-?$?x$ h<D»*1f*i:£, flr IB 2 ^7ciftlfta)MA1ff4B t L X 

2. 2&7ci&it£f i -£ t Lxmm-tzmz, mm2^.7t^(D^- 

3. 2&7CBfe&£T ? -£ t L"CSttf ltlfB2^7C^{t(D-7 i - 

15 f£Ji<D#®iit:r£(DJ?«^11ffg<!:£, TifilB 2 &7cl|fctt<Z>ttMfl! ft <!: L X m 

4. 2&7tmm&?-$ t Lra«-r«»iz. BiiiB2^5ci*^(D-7 ; - 

■*"HfT#1*«£:£, HtrlB2 3fe5clft«G>#JSW«i: L T MS K 2 & 5c Bfete <B 

5. Iff^Hl 7!iSiS*:«4a)^r*L36McflBS6(7)fi:tt:?affllft«ia^^rgfe 

6. if ^in 7bmm&&s<D^i?frfr\zmM<»±Lm%m!&&&&j3m 



WO 2004/049735 PCT/JP2003/012177 

11 

fflriB2^5cllft«a>#JBW#i: LT^2&tuI!&^(Z>-x-£ <h&lcilf*fc-f 

^—^ommmmm^mwE. 2 XTtrnmonmrnm. t lx mm 2 & 75 

10 ^-^ 5^S£s 55U ^HtcD^r — $ (cH-3iNTSiJfi*#£l!fIlE:LE(* 

15 9. 2 &7C#H#>0)^— £ «hBUfB2 ^7C^it±(7)^t-^vx £ KO^IuillJ 

20 10. 2&n&feo?-$ km&2&nm&±<D&mmzk<D^-ffim 
25 11. ^^^a>R*^<©j&:^^e» -&&&mi*x±Li&&mm7ji&ftte5 



WO 2004/049735 




PCT/JP2003/012177 



12 



WO 2004/049735 PCT/JP2003/012177 



1/4 



(a) 



100 







X ) 


















JDDflP 









(b) 



105 




104R 



104L 



Cc) 













□□op 9 


0 




WO 2004/049735 



PCT/JP2003/012177 



2/4 

H2 



mm 










m 


























%2 




m m m 






(b) 


101 


1 




— -H 




-—103 



(c) 



101 

-V- 



-•^102 

105 



103 



WO 2004/049735 




PCT/JP2003/012177 




(c) 



WO 2004/049735 




PCT/JP2003/012177 



4/4 



INTERNA'WWf AL SEARCH REPORT f^Krnational application No. 

PCT/JP03/12177 



A. CLASSIFICATION OF SUBJECT MATTER 
Int. CI 7 H04N13/00, H04N7/08 



According to International Patent Classification (IPC) or to both national classification and IPC 
B. FIELDS SEARCHED 

Minimum documentation searched (classification system followed by classification symbols) 
Int. CI 7 H04N13/00, H04N7/08 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 
Jitsuyo Shinan Koho 1922-1996 Toroku Jitsuyo Shinan Koho 1994-2003 

Kokai Jitsuyo Shinan Koho 1971-2003 Jitsuyo Shinan Toroku Koho 1996-2003 

Electronic data base consulted during the international search (name of database and, where practicable, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



X 
A 



JP 09-289638 A . (NEC Corp.), 
04 November, 1997 (04.11.97), 

Page 4, right column, line 16 to page 5, left 
column, line 32; Figs. 1, 10 to 12, 25 
& US 6111979 A 

JP 2002-095018 A (Canon Inc.), 
29 March, 2002 (29.03.02), 

Page 11, left column, line 4 6 to right column, 

line 4; Fig. 13 

& US 2002/003675 Al 



1-6,8-10 



7,11 
1-6,8-10 



| | Further documents are listed in the continuation of Box C. | | See patent family annex. 



"A" 



Special categories of cited documents: 
document defining the genera) state of the art which is not 
considered to be of particular relevance 
"E" earlier document but published on or after the international filing 
date 

"L M document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of another citation or other 
special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or other 
means 

"P" document published prior to the international filing date but later 
than the priority date claimed 



T later document published after the international filing date or 
priority date and not in conflict with the application but cited to 
understand the principle or theory underlying the invention 

"X" document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive 
step when the document is taken alone 

"Y" document of particular relevance; the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such 
combination being obvious to a person skilled in the art 
document member of the same patent family 



Date of the actual completion of the international search 
26 December, 2003 (26.12.03) 


Date of mailing of the international search report 

20 January, 2004 (20.01.04) 


Name and mailing address of the ISA/ 

Japanese Patent Office 

Facsimile No. 


Authorized officer 
Telephone No. 



T7™*r« DPT/IQA/Oin fcA/>rmrl s-hftRt\ Cllilv 1QQR\ 



INTERNATIONAL SEARCH REPORT 



imationa] application No. 
PCT/JP03/12177 



Box I Observations where certain claims were found unsearchable (Continuation of item 2 of first sheet) 



This international search report has not been established in respect of certain claims under Article 17(2)(a) for the following reasons: 
1. | | Claims Nos.: 

because they relate to subject matter not required to be searched by this Authority, namely: 



2. j^j Claims Nos.: 

because they relate to parts of the international application that do not comply with the prescribed requirements to such an 
extent that no meaningful international search can be carried out, specifically: 



3. Claims Nos.: 

because they are dependent claims and are not drafted in accordance with the second and third sentences of Rule 6.4(a). 



Box II Observations where unity of invention is lacking (Continuation of item 3 of first sheet) 



This International Searching Authority found multiple inventions in this international application, as follows: 

Claims 1-6, 8-10 relate to an idea of providing thickness information on 
an object on a two-dimensional video , as additional information. 

Claims 7, 11 relate to an idea of providing, as additional information, 
imaging information that is at least one set of a viewpoint distance information 
set, an angle information set including information on the angle between the 
lines joining the adjoining viewpoints and an object, an optical axis cross 
position information set, a focal length information set, and a viewing angle 
information set. 



1. [ [ As all required additional search fees were timely paid by the applicant, this international search report covers all searchable 

claims. 

2. fx"] As all searchable claims could be searched without effort justifying an additional fee, this Authority did not invite payment 

of any additional fee. 

3. | | As only some of the required additional search fees were timely paid by the applicant, this international search report covers 

only those claims for which fees were paid, specifically claims Nos.: 



4. | [ No required additional search fees were timely paid by the applicant Consequently, this international search report is 
restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 



Remark on Protest j^J The additional search fees were accompanied by the applicant's protest. 

| | No protest accompanied the payment of additional search fees. 



Form PCT/ISA/210 (continuation of first sheet (1)) (July 1998) 



mmmm^ PCT/JP03/12177 



a. 3m<r>m-rz>ftm<n$rm {w&m&m (ipo ) 

Int cl 7 H04N13/00 HT04N7/08 



w3ESrtfofc«/Mjwfl. (mm¥ffi&m (ipo ) 

Int cl 7 H04N13/00 H04N7/08 



B#HH/B£lrlg<&f8 1 9 22-1 9 96^ 

B#H<kMII£l#r3k&fft 19 71-200 3? 

B#HS^I?ffi§rf&&fft 19 94-2003^ 

B#fflJ&E$f^£«Sfc4M8 1 9 96-2003? 



c. 







mm-rz 


A 


JP 09-289638 A ( B *«ac«a£#*fc) 1 9 9 7. 
11. 0 4 141*111 6|T-I51fclf 3 2fr iMfl 
$£10-12 EUf&25|g & US 611 1979 A 


1-6, 8- 
1 0 


X 


JP 2002-095018 A (^t^Vt^tt) 2 00 

2. 0 3. 29 mi m&wmi en-^mm^n mmmi3 

HI & US 20 0 2/0 0 3 6 7 5 Al 


7,11 


A 




1-6, 8- 
1 0 



BSg b < fcWUltf>#SiJ#3gftl *mtL-f2> fc«>legiJIH-$ 

rpj H^ffijpBffiT% a>^m%;m<D£M<Dmmbt£Z>mm 



2 6. 12. 0 3 



B#B#FF/f (I SA/J P) 
100-8915 



20. 1. 2004 



03-3 581-1101 



5 P 



8 4 2 5 



3 5 8 0 



KPCT/ISA/2 10 (12^) (1 998f7fl) 



PCT/J PO 3/1 2 17 7 



M8^31 (PCT 1 7^(2) (a)) 9 , i©BiBMiat«*f±*©aftlci OBI*©^©— «Jfcov^f^ 



3. □ ft3fc©$5ffl » % l^»*©|fiiB^*oTPCT^6.4(a)©*2»tJ«IS3S:©aj£fc 



'If £ b TSftt 5 t <0 "X* fe -5 o 



1. □ mmA^mj:mm^mm^ir-<xmm\HimH^it<Dx\ z<Dmmmmi&t£, -r^xom&fimttmik 



4. □ UlJHA^^^i9*«^»IWrtl^#U*^ofc<0-e, ^©HI^8SiM#f4, SfsfttfJflSBK&^&HCiBii 



l»IBE¥JWf©*Ko if ire fc§§-f 5 sag 



iSPCT/ISA/2 10 (J&l^-SJOUHS (1) ) (1 998^7^) 



